Microscopic theory of quantum anomalous Hall effect in graphene 
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We present a microscopic theory to give a physical picture of the formation of quantum anomalous 
Hall (QAH) effect in graphene due to a joint effect of Rashba spin-orbit coupling Xr and exchange 
field M. Based on a continuum model at valley K ox K' , we show that there exist two distinct 
physical origins of QAH effect at two different limits. For M/Ar 3> 1, the quantization of Hall 
conductance in the absence of Landau-level quantization can be regarded as a summation of the 
topological charges carried by Skyrmions from real spin textures and Merons from AB sublattice 
pseudo-spin textures; while for Xr/M 2> 1, the four-band low-energy model Hamiltonian is reduced 
to a two-band extended Haldane's model, giving rise to a nonzero Chern number C — 1 at either 
K or K' . In the presence of staggered AB sublattice potential U, a topological phase transition 
occurs at U — M from a QAH phase to a quantum valley-Hall phase. We further find that the 
band gap responses at K and K' are different when Xr, M, and U are simultaneously considered. 
We also show that the QAH phase is robust against weak intrinsic spin-orbit coupling Xso, and 
it transitions a trivial phase when Xso > (a/ M 2 + X R + M)/2. Moreover, we use a tight-binding 
model to reproduce the ab-initio method obtained band structures through doping magnetic atoms 
on 3 x 3 and 4x4 supercells of graphene, and explain the physical mechanisms of opening a nontrivial 
bulk gap to realize the QAH effect in different supercells of graphene. 



PACS numbers: 73.43.-f, 72.20.-i, 73.22.Pr, 75.50.Pp 

I. INTRODUCTION 

In 1879, Edward H. Hall discovered that when an elec- 
tric field flows through a conductor in the presence of 
a perpendicular magnetic field, charge carriers subjected 
to the Lorentz force are pushed to one side of the conduc- 
tor. At equilibrium, the carrier accumulation generates a 
transverse bias to balance the Lorentz force. This is the 
famous "Hall effect". In two-dimensional electron sys- 
tems, the quantized version of Hall Effect was observed 
due to Landau quantization^ which is characterized by a 
precisely quantized Hall conductance, i.e. a xy = C e 2 /h, 
where C is known as the TKNN number or Chern num- 
ber I 2 -! 3 - 

To produce a Hall effect, breaking time- reversal sym- 
metry is an essential condition. In addition to magnetic 
field, an internal magnetization coupled with spin-orbit 
coupling could also give rise to the Hall effect. To distin- 
guish from the ordinary Hall effect, this magnetization- 
induced one was called "anomalous" Hall effect. Al- 
though it has been experimentally observed for over one 
century, the physical origin of anomalous Hall effect is 
still unclear. In general, the mechanism of anomalous 
Hall effect is classified as extrinsic or intrinsic according 
to its origins. The extrinsic one arises from the spin- 
dependent scattering impurities, while the latter one can 
be expressed in terms of Berry-phase curvatures in the 
crystal momentum space4^ 

Similar to the quantization of the ordinary Hall effect, 
the anomalous Hall effect was also predicted to be quan- 
tized by Haldane in a honey-comb lattice toy model with 
vanishing magnetic field. 6 Subsequently, other proposals 
were made toward the realization of quantum anoma- 



lous Hall (QAH) effect, i.e. in Mercury-based quantum 
wellsj 7 - disorder-induced Anderson insulator, 8 optical lat- 
tices^ and magnetic topological insulators Despite the 
theoretical progress, the QAH effect has yet observed 
experimentally. In a recent paper ; 11 ' 12 we found that 
graphene shows great potential to host the long-sought 
QAH state in the presence of Rashba spin-orbit cou- 
pling and exchange field. Based on the state-of-the-art 
first-principles calculation method, researcher a 13 ' 14 fur- 
ther demonstrated that this QAH phase could be engi- 
neered via doping 3d or 5d transition metal atoms on the 
hollow sites of graphene. The final realization of QAH 
effect will not only enable the application of novel quan- 
tum devices due to the dissipationless nature, but also 
mark the ultimate achievement of a clear understanding 
of the intrinsic mechanism of the anomalous Hall effect. 4 

In this paper, we demonstrate a microscopic the- 
ory to study the physical origins of the QAH effect 
in graphene due to the presence of both Rashba spin- 
orbit coupling and exchange using a low-energy contin- 
uum model. In the limit of strong exchange field and 
weak Rashba spin-orbit coupling, the quantization of the 
Hall conductance should be attributed to the real spin 
texture-induced Skyrmions and AB sublattice pseudo- 
spin texture-induced Merons. While in the other limit, 
i.e. weak exchange field and strong Rashba spin-orbit 
coupling, the four-band low-energy model can be reduced 
to a two-band extended Haldane's model. We also show 
that this QAH phase is robust against weak staggered 
AB sublattice potentials or intrinsic spin-orbit coupling, 
which is present in real materials. Using a tight-binding 
method, we reproduce all the ab-initio obtained band 
structures of doping magnetic atoms in 3 x 3 or 4 x 4 
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supercells of graphene. And we give an explanation of 
the formation mechanism of the QAH effect in 3 x 3 or 
4x4 supercell of graphene. 

The remainder of the paper is organized as follows. In 
Sec. HH we present tight-binding and continuum models 
of graphene in the presence of Rashba spin-orbit cou- 
pling, intrinsic spin-orbit coupling, exchange field, and 
staggered AB sublattice potential. Section ITlTI discusses 
the physical origin of the quantum anomalous Hall ef- 
fect in graphene at two different limits using a contin- 
uum model. In Sec. IIV1 we show the robustness of the 
quantum anomalous Hall state in the presence of either 
staggered AB sublattice potential or intrinsic spin-orbit 
coupling. In Sec. [V] we use a tight-binding model to 
explain a recent ab-initio work about realizing the quan- 
tum anomalous Hall effect in 3 x 3 and 4x4 supercell of 
graphene. A brief summary is given in Sec. I VII to close 
the paper. 



By performing a Fourier transformation, the real space 
Hamiltonian in Eq. @ is converted to a 4 x 4 matrix 
H(k) in the momentum space. In this paper, we choose 
the lattice unit vectors to be 



a 1 = ^(2V3, 0),a 2 = |(V3, 3), 



(2) 



and the corresponding reciprocal-lattice vectors are given 
by 



2tt , 1 -1. , 2tt, 2 N 
bi = — H=, — ,6 2 = — 0, - . 
o y/3 3 a 3 



(3) 



where a = 1.42 A is the distance between nearest neigh- 
bor carbon-carbon atoms, and we set a to be unity in 
the following calculation for simplicity. On the basis of 
{ipAf, tpBf, i^B},}, the corresponding momentum- 

space Hamiltonian of each term is listed in the following. 
(A) Nearest-neighbor hopping term: 



II. MODEL HAMILTONIAN OF GRAPHENE 

The real space 7r-orbital tight-binding Hamiltonian of 
single layer graphene in the presence of Rashba/intrisic 
spin-orbit coupling, exchange field and staggered AB sub- 
lattice potentials is written a o 11 ' 15 ? 16 : 

H{r) = H Q {r) + H R (r) + H so (r) + H M {r) + Hu(r),(l) 

where each term is given by 



Mr) = -* £ 



(ij);a 

Hr(t)=Ur £ e z -(s al3 xd ij )c\ a c j 0; 

Hso{r) = -jfso Yl 4 s -( d fcj xd *fc) c j; 
H M (r) = Mj2 4X^/3! 
H u{r) =Y24 a Via a . 

i',a 

Here, c\ a and Ci a are 7r-orbital creation and annihilation 
operators for an electron with spin a on site i. The first 
term Hq represents the nearest neighbor hopping with 
amplitude t = 2.6 eV. The second term Hr describes the 
Rashba spin-orbit coupling with dy being a lattice vector 
pointing from site j to site i. The third term Hso is the 
intrinsic spin-orbit coupling with k connecting the next- 
nearest neighbor sites i and j. (}/^3> runs over all the 
nearest/next-nearest neighbor hopping sites. The fourth 
term and the last term correspond to the exchange field 
and staggered ^4i?-sublattice potentials, respectively. We 
set Vi — +U at .4-type sublattices and Vt — — U at B- 
type sublattices. a and /3 denote spin indices, and s are 
the spin Pauli matrices. 



Ho{k) = -t 



70 
7o 



with 



IVo v3fe feu . , \ 
7o = [(2 cos — - — cos — + cos k y ) 

+i{2 cos — - — sin — smky)\l s , 

where l s is a 2 x 2 identity matrix. 
(B) Rashba spin-orbit coupling term: 



H R (k) = t R 







with 



JR 



V^fex . ky 

sm — 

2 2 



sin k„ 



. i v3fea: fe-u j m 

-«(cos — - — cos — cos ky)\s x 

r— . ^/3k x . . ky ky 

- V 3 sm [i sm — + cos — )s«. 

2 2 2 * 



(C) Intrinsic spin-orbit coupling term 
Hso(k) = t S o 

where 



iso 
-7so 



iso = -4t S o sm (cos — - 



cos ■ 



(4) 



(5) 



(6) 



(D) Exchange field term: 
H M (k) = M 



s z 
s z 



(7) 
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(E) Staggered AB sublattice potential term: 
H v (k) = U 



Is 

-l f 



(8) 



By directly diagonalizing H(k) at each crystal momen- 
tum fc, one can easily obtain the bulk band structure. As 
reported in a recent paper—, we found that a nontrivial 
bulk gap opens when both the Rashba spin-orbit coupling 
tn and exchange field M are considered simultaneously. 
Through calculating the Chern number by integrating 
the Berry curvatures in the first Brillouin zone, we found 
that the resulting Chern number is nonzero, indicating 
a quantum anomalous Hall state. The central issue in 
this paper is to give a physical picture to understand the 
formation of this nontrivial state. Therefore, the study 
the low-energy effective model is required. 

Through expanding the tight-binding Hamiltonian in 
Eq.(g]) - Eq.© at the vicinity of valleys K and K', i.e. 
(k x , fc y ) = (±4 7 r/3 v / 3, 0), the low -energy effective model 
Hamiltonian of each term at valleys K and K 1 is summa- 
rized as following on the basis of {ipAf> ipAi, ipBf> tpBi}'- 



h {k) = 


v{r}cr x k x + a y k y )l s ; 


(9) 


h R (k) = 


^(WxSy - o y s x ); 


(10) 


h S o{k) 




(11) 


h M {k) = 


= Ml (7 s z ; 


(12) 


h v (k) = 


Ua z l s . 


(13) 



Here, n = ±1 labels valley degrees of freedom; cr are Pauli 
matrices representing the j4B-sublattice pseudo-spin de- 
grees of freedom. The Fermi velocity, Rashba spin-orbit 
coupling, and intrinsic spin-orbit coupling are given by 
v = 'it/ '2, A;? = 3tft, and Xso = 3V3tso, respectively. 



III. PHYSICAL ORIGIN OF QUANTUM 
ANOMALOUS HALL EFFECT 

When the Rashba spin-orbit coupling Ar and exchange 
field M are taken into account simultaneously, the con- 
tinuum model Hamiltonian is 



H(k) = h (k) + h R (k) + h M (k) 



(14) 



In Refs. |llUl2j |. we have pointed out that a nontrivial 
bulk band gap opens up as long as Ar and M are nonzero. 
Based on the Kubo formula, when the Fermi energy lies 
within the bulk band gap, the corresponding Hall con- 
ductance <j xy is shown to be quantized as: 



cr 



xy -= C— sgn(M), 



(15) 



where the Chern number is C = 2 and can be calculated 
from 



K,K' n=l,2 



dk x dkyQ n (k x , ky). (16) 



The sum is taken over both valley K/K' and n occu- 
pied valence bands below the bulk band gap. fl n is the 
momentum-space Berry curvature of the n-th band, and 
can be obtained through the following formula 



^ (fc) - - ^ 2lTlll \i>nk\Vx\i>n>k) (VV k\v y \lpnk) 



(w n ' - W„) 2 



(17) 



where u n = E n /h, and v x ^ is the Fermi velocity opera- 
tor. 

It is already known that the Chern numbers of valleys 
K and K' are equal—S i.e. Ck — Ck' — 1- However, the 
component from each valence band is still unclear. For 
clarity, we label the lowest valence band as the 1st band, 
and the other one close to the bulk band gap as the 2nd 
band. Figure Q] plots the Chern number of each band and 
the total Chern number as functions of exchange field M 
and Rashba spin-orbit coupling A_r. In Fig. HJa), the 
exchange field is fixed at M/t = 0.3. We find that, for 
extremely small Rashba spin-orbit coupling \r — > 0, the 
Chern number of the 1st valence band is half-quantized 
with a negative sign, i.e. C\ = —0.5; and that of the 2nd 
valence band is one and half quantized, i.e. C2 = 1-5. 
When Rashba spin-orbit coupling \r gradually increases, 
the absolute values of C\ and C2 are both reduced. On the 
contrary, in Fig. [ljb) Rashba spin-orbit coupling is fixed 
to be Afl/t = 0.3. One observes that for extremely weak 
exchange field M — > 0, the 1st valence band gives no 
contribution to the total Chern number, i.e. C\ = and 
C-2 = 1. Along with the increasing of the exchange field, 
C\ increases with a negative sign, while C2 is also linearly 
increased, keeping the total Chern number quantized to 
beC = l. 

Based on the analysis of the Chern number response at 
the two different limits, i.e. M/Ar ^> 1 and Ar/M 3> 1, 
one can imagine that the resulting Hall conductance 
quantization should correspond to different formation 
mechanisms. In the following, we give a clear understand- 
ing of the physical origins of the quantum anomalous Hall 
effect at the two different limits. 



A. M/\r 2> 1 Limit: Skyrmion and Meron 

From Fig. QJa), one can n °te that both valence bands 
contribute to the total Hall conductance, therefore the 
four-band Hamiltonian can not be reduced to a two-band 
effective Hamiltonian model. In the following, we study 
the origin of the Hall conductance from each band. In 
our studied single layer graphene system, there are two 
kinds of spin degrees of freedom: real spin s and AB 
sublattice pseudo-spin cr. On the basis of {ipA^t, Vvlj,, 
ipBt, V'sj.Ij th e real spin and pseudo-spin components 
can be evaluated through 

(si) = (ifj\ 1 (j <8> s, 

(cr,) = M <T t ® l s |^), (18) 
where i = {x, y, z}, and \ip) is a 4 x 1 eigenvector. 
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FIG. 1: (Color online) Upper panel: Chern number of each 
valence band as a function of Rashba spin-orbit coupling Xr at 
fixed exchange field M/t — 0.3; Lower panel: Chern number 
of each valence band as a function of exchange field M at 
fixed Rashba spin-orbit coupling Xn/t = 0.9. The solid (blue) 
line represents the summation of the two valence bands. The 
cutoff of k x and k y are set to be ho = n /2a. 



In Fig. [2] we exhibit the spin textures of the real spin 
and AB sublattice pseudo-spin at valleys K and K' for 
the two valence bands below the bulk band gap, respec- 
tively. One can observe that the real spin textures of the 
two valence bands of valley K are exactly the same as 
that of valley K 1 [see Fig. C|a)-Fig. l - e - for the lst 

band the spins are uniformly pointing toward the south 
pole in the whole momentum space, contributing nothing 
to the total Chern number; while for the 2nd band the 
spins close to valleys K and K' point toward the south 
pole whereas those far away from the center point toward 
the opposite north pole [Note that there should exist a 
circular region with spin lying within the in-plane of the 
equator] , which phenomenally corresponds to a Skyrmion 
that contributes to one topological charged 

However, it becomes more complicated for the AB sub- 
lattice pseudo-spin textures [see Fig. |2fe)-Fig. |2)[h)]. For 
valley K, one can see that the in-plane pseudo-spin com- 
ponents of both valence bands point toward the center 
with the same winding pattern; the out-of-plane pseudo- 
spin components close to the center point toward either 
the south pole (lst band) or north pole (2nd band), but 
those far away from the center are vanishing. For valley 
K', one finds that the pseudo spin textures are distinct 
from those at valley K . For example, the in-plane pseudo 
spins point toward the center without any winding, while 
the out-of-plane pseudo spins only exist near the valleys 
and point to either the north pole (lst band) or south 
pole (2nd band). All these suggest that each of the four 
different pseudo spin textures corresponds to a Meron, 
i.e. half-Skyrmion. 18 



To confirm the above analysis, we should precisely cal- 
culate the Chern number (or topological charge) resulting 
from each special real spin or pseudo-spin texture using 
the following formula 



1 

47T 



dk x dk y (d klc h x d k h) ■ h, 



(19) 



where n is a topological charge counting the number of 
times a unit vector h(k) winding around the unit sphere 
as a function of k. h(k) = h(k)/\h(k)\ with h(k) rep- 
resenting the projection of the Hamiltonian shown in 
Eq. (|14p into the real spin or pseudo-spin space. For 
Mj Aij 3> 1 , our numerical calculation shows that 



„K' 



= 0; 



1.0; 

-0.5; 

0.5. 



(20) 
(21) 
(22) 
(23) 



Therefore the corresponding Chern numbers become 



cf 


= nf s H 




-- -0.5; 


(24) 


cf 


= 


+ <' 


= -0.5; 


(25) 


cf 


= nf s H 


-«£ = 


= 1.5; 


(26) 




- n K ' 


+<' 


= 1.5; 


(27) 


C K 


= cf + 


-c 2 K = 


i; 


(28) 


C K ' 


= cf 


+ cf 


= l. 


(29) 



From the relationship shown in Eqs. ([221) and (|23|) . one 
can find that though the spins point to opposite poles (for 
example, see the pseudo spin textures of the lst valence 
band at K and K'), their different winding patterns give 
rise to the same winding number. 

Therefore, in the limit of M/Xr 1, the formation 
of the quantum anomalous Hall state originates from 
both Skyrmions carried by the real spin textures and 
Merons carried by the AB sublattice pseudo-spin tex- 
tures. Quantitatively, the pseudo-spin induced topolog- 
ical charges n from lst and 2nd valence are exactly op- 
posite to cancel each other, which makes the real spin- 
induced Skyrmions from 2nd become the only source to 
achieve the quantized Hall conductance without external 
magnetic field. 



B. Xr/M > 1 Limit: An Extended Haldane Model 

In the limit of strong Rashba spin-orbit coupling Xr 
and weak exchange field M, the total Chern number 
mainly comes from the 2nd valence band while the con- 
tribution from lst valence band is negligible as shown 
in Fig. [TJb), i.e. C\ ~ and C% — 1. This indicates 
that it is possible to obtain a reduced effective two-band 
model Hamiltonian through disregarding the high-energy 
bands. By reconstructing the basis to be {^Af> V'Bi, V'-Bf) 
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FIG. 2: Real spin and pseudo-spin textures of the two valence bands of graphene below the band gap at valleys K and K' 
in the limit of M/Xr 3> 1 (here, we set M = 0.8 and Xr — 0.12). (a)-(d): Real spin textures of the 1st and 2nd valence 
bands at valleys K and K' . (a) and (c): Spins point toward the south pole uniformly; (b) and (d): Spins at the center point 
toward the south pole while those far away from the center point toward the north pole, which indicates a Skyrmion. (e)-(h): 
Pseudo-spin textures of the 1st and 2nd valence bands at valleys K and K' . (e) and (f): In-plane pseudo-spin components 
share the similar winding pattern pointing toward the center, but out-of-plane pseudo-spin components point toward south 
and north poles, respectively; (g)-(h): In- plane pseudo-spin components point toward the center without any winding, while 
out-of-plane pseudo-spin components point toward north and south poles, respectively. Each pseudo spin texture corresponds 
to a Meron or half-Skyrmion. 



ipA\\, the continuum Hamiltonian at valley K is written 
as 



H K = 



becomes 



















- M 







" 








M 





vk- 


" 








H K , = 





—M 





— v fc+ 




' Hi 


-T 





—M 





vk + 






T ' 


— v fc+ 





M 






__ T t 


m 


vk+ 





M 






Tt 


H 2 







— vk- 


-i\R 


-M _ 







vk- iX 



R 



-M 



where Hi and H 2 represent the two block Hamiltonians 
on the basis of (ipA-f, ipBi) and (i/'sti V'aj.), respectively; 
T couples the two different blocks. At the vicinity of 
K, Hi and H 2 correspond to the low energy band (i.e. 
e = ±M) and high energy band (i.e. e = ±V ' M 2 + X 2 R ), 
and the coupling T becomes extremely weak. Therefore, 
an effective Hamiltonian can be obtained to describe the 
low-energy physics at K point: 

Hf s ~Hi- TH 2 l T^ = d z a z + d y a y + d x a x , (30) 



d z = M(l - ^k 2 ); 



d y — - (k x k ); 



d x — 2 k x ky. 



Similarly, after reconstructing the basis to be {ipBt, ipA±> 
ipA\i ipB\}, the continuum Hamiltonian at at valley K' 



Using the similar method in Eq. (j3"0")) . we can obtain the 
reduced effective two-band model Hamiltonian at the 
vicinity of K 1 



H 



K' 



Hi - T(Hl)- 1 ^ = d z a z 



dyOy 



(31) 



Through comparing the obtained effective Hamiltonian 
at K/K' in Eqs. (O and (JSTJ) with the famous Haldane's 
toy model in Ref. [6(, we find that they share the sim- 
ilar characteristic form. Especially, when k 2 > X 2 R /v 2 , 
the coefficient of d z can change its sign from positive to 
negative. This signals that the reduced effective Hamilto- 
nians are definitely extended Haldane's models to exhibit 
a nonzero Chern number. Since the sign is directly re- 
lated to d z and d z is an odd (even) function with respect 
to M (Xr), the sign of the resulting quantum Hall con- 
ductance should only be dependent on M. Moreover, the 
coefficient of a z in Eq. (|3 1 [) is exactly the same as that in 
Eq. (f3T)]) . Therefore, according to Eq. (ITO|) both effective 
Hamiltonians at K and K' give rise to the same Chern 
number, thus the total Chern number is C = 2sgn(M). 
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IV. ROBUSTNESS OF QUANTUM 
ANOMALOUS HALL EFFECT 

A. Staggered AB Sublattice Potential 

When graphene is doped with some magnetic atoms 
on the top of carbon atoms, i.e. one adatom sitting 
on top of the carbon atom ina4x4or5x5 super- 
cell of graphene, besides the magnetic proximity-induced 
exchange field and the interaction-induced Rashba spin- 
orbit coupling, the imbalanced AB sublattice potentials 
may also be introduced^ In the following, we address the 
possible effect of the staggered AB sublattice potentials 
on the quantum anomalous Hall state. In the low-energy 
limit, the effective Hamiltonian in the presence of Rashba 
spin-orbit coupling A_r, exchange field M and staggered 
sublattice potential U on the basis of {ipAti V'aj.j ^Bfi 
ipBi} is written as: 

H(k) = h (k) + h R (k) + h M (k) + hu(k). (32) 

After a direct diagonalization of the above Hamiltonian, 
the energy dispersion can be expressed as 

e{k) = fiy/p + vy/Q, (33) 
with P and Q being the following 

P = M 2 + U 2 + ^X 2 R + v 2 k 2 ; 

Q = X 4 R /4 + v 2 k 2 X 2 R + 4v 2 k 2 M 2 ~2r]MUX 2 R + AM 2 U 2 , 

where fi = ±1 stands for the conduction (+) and valence 
(-) bands; v = ±1 denotes the spin chirality. By imposing 
k = 0, the bulk band gap A at valleys K and K' can be 
determined to be: 

A = 2|Af-ry[/|, (34) 

which indicates that at valley K (i.e. rj = +1), along 
with the increasing of the staggered AB sublattice po- 
tential U from zero, the bulk band gap A first decreases; 
at a critical M = U point, the bulk gap is completely 
closed; when U further increases to be larger than M, 
a finite bulk gap reopens, indicating a topological phase 
transition. However, at the other valley K' (i.e. rj = — 1 ), 
the bulk gap A always increases and does not experience 
a topological phase transition. The different bulk band 
gap responses at K and K' are consistent with the tight- 
binding result discussed in Ref. (l9j . 

For a small staggered AB sublattice potential U, the 
system is in a the quantum anomalous Hall phase: both 
valleys induce the same unit topological charge Ck = 
Ck' = 1- As long as the bulk gap is not completely 
closed at both K and K', the system should always 
belong to the quantum anomalous Hall phase. When 
U > M, a topological phase transition occurs at valley 
K, indicating a band inversion with Chern number be- 
coming Ck = — 1- Since the topology at the valley K' 



always stays the same, i.e. Ck> = 1, therefore the total 
Chern number vanishes with C = Ck + Ck> = 0. But 
the difference of Chern numbers at K and K' result in 
a quantum valley-Hall phase with valley Chern number 
C v = {Ck —Ck')/2 = 1- Though the resulting new phase 
is the same as that in a gated bilayer graphene in the pres- 
ence of Rashba spin-orbit coupling and exchange field, 1 - 
the major difference is that the bulk gaps at K and K' 
are simultaneously closed at some critical paramters^ 

In a gated bilayer graphene, when only the Rashba 
spin-orbit coupling is applied, the system experiences a 
topological phase transition from a quantum valley-Hall 
phase to a two-dimensional strong topological insulator 
phase through tuning the gate bias between top and bot- 
tom layers^ It is natural to hope that similar topological 
insulator phase can be realized by considering staggered 
AB sublattice potential and Rashba spin-orbit coupling 
in a single layer graphene, since staggered AB sublattice 
potential plays a similar role to break the out-of-plane 
inversion symmetry as the gate bias in bilayer graphene. 
However, we show that it is not the case. From Eq. (|34[) . 
one can find that the bulk band gap is only dependent 
on the staggered AB sublattice potential U and the ex- 
change field M but independent of the Rashba spin-orbit 
coupling strength. Thus, it is obvious that the resulting 
bulk gap in the absence of exchange would be a constant 
for any Rashba spin-orbit coupling strength at a fixed 
staggered potential U. This signals that topological in- 
sulator state can not be achieved in single layer graphene 
through tuning Rashba spin-orbit coupling. 



B. Intrinsic Spin-Orbit Coupling 

Since the spin-orbit coupling (Rashba or intrinsic) in 
pristine graphene is very weak, one has to employ ex- 
ternal means to enhance it. Recent ab-initio studies 
reported that a better approach to enlarge the Rashba 
spin-orbit coupling is via doping low-concentration 3c? 
or 5rf transition metal atoms on the hollow adsorption 
sitesi 13 ' 14 Though we only prefer the Rashba type spin- 
orbit coupling, the enhancement of the intrinsic one is 
unavoidable^ In the presence of intrinsic spin-orbit cou- 
pling, Rashba spin-orbit coupling and exchange field, the 
continuum Hamiltonian is written as 

H(k) = h (k) + h R (k) + h so {k) + h M (k). (35) 

Through diagonalizing Eq. (|35[) at k = 0, the energy 
spectrum at K can be expressed as: 

ef = +M + Aso; 
4 = -M + Xso; 
ef = +^/AP + \ 2 R -\so; 

ef = -^M 2 + X 2 R -Xso- 



And the corresponding energy spectrum at K' are 
ef = +^ M 2 + X 2 r + Xso . 

ef = +M-X so ; 

ef = -yV + Afj + Aso; 

ef - -M-Xso- 

In general, the strength of the adatom-induced intrin- 
sic spin-orbit coupling is an order of magnitude smaller 
than the induced Rashba strength, i.e. Xso ^ ^-Ri an d 
the exchange field is often lager than the Rashba spin- 
orbit coupling strength. Therefore, the resulting bulk 
band gaps at K and K' are 

A K = £ f - £ f = ^M 2 + X 2 R + M- 2X so ; (36) 

A K > = ef - ef = 2M. (37) 

This indicates that the bulk gaps show different responses 
at K and K' . As long as X S o < (V ' M 2 + X 2 R + M)/2, the 
quantum anomalous Hall phase would be robust against 
the weak intrinsic spin-orbit interaction. 

From the theoretical point of view, if the intrinsic term 
is comparable with Xr and M or even larger, the band 
gap at K' changes to be the same as that at K, i.e., 

Ax = |ef - ef | = \^M 2 + X 2 R + M - 2X so \; (38) 
A K , = \ef - ef | = | Jm 2 + A| + M — 2A so [39) 

Therefore, at X SO = W M 2 + X R + M)/2, the bulk band 
gap completely close at both K and K'. And it en- 
ters a new phase C = when the intrinsic spin-orbit 
coupling Xso further increases. Due to the presence of 
the exchange field M , the time-reversal symmetry is bro- 
ken. Thus, it is no longer a intrinsic spin-orbit coupling- 
induced two-dimensional topological insulator. In a re- 
cent paper, it has been reported that this new phase 
is a time-reversal symmetry broken quantum spin-Hall 
phased 

V. THEORY OF METAL ADSORPTION ON 
3x3 AND 4x4 SUPERCELLS OF GRAPHENE 

In the previous sections, we have assumed that all 
involved parameters are uniformly distributed on each 
atomic site of the graphene sheet. However, in a more 
realistic graphene sample, the atom dopants are usually 
adsorbed on graphene with a low concentration to avoid 
the direct transport through dopants themselves. For ex- 
ample, the mostly adopted systems in the ab-initio study 
are 3x3, 4x4, 5x5 and 7x7 supercells of graphene. 
For 3x3 supercells, valleys K and K' are coupled to the 
r point resulting in the mixtures of valleys, but in the 
last three kinds of supercells valleys K and K' are sep- 
arated and well-defined to be good quantum numbers. 
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FIG. 3: Schematic plot of (a) 4 x 4 and (b) 3 x 3 supercells of 
graphene. On-site crystal field potential, Rashba spin-orbit 
coupling, and exchange field are only considered on the high- 
lighted sites. 

Therefore, in the following discussion we only consider 
two representing 3x3 and 4x4 supercells of graphene 
using the tight-binding methods. 

There are three highly possible adsorption points in 
graphene: top, bridge, and hollowi 13 ' 24 In Ref. we 
have shown that only the hollow-site adsorption can open 
a nontrivial bulk gap to achieve the quantum anoma- 
lous Hall state. An obvious characteristic of this kind of 
adsorption is that the induced effects are non-uniformly 
distributed in the supercell, i.e. the six nearest carbon 
atoms under the metal adatom experience the largest ex- 
change field M and Rashba spin-orbit coupling while 
for the other carbon atoms the longer the distance from 
the adsorption site, the smaller the induced interactions. 
Another most important term arisen from the adsorption 
is the crystal field stabilization energy Vb (also known as 
on-site energy) , which is the main factor coupling valleys 
K and K' in the 3x3 supercell of graphene when Rashba 
and exchange effects are absent. 

As shown in Fig. |31 we schematically plot the 4 x 4 (a) 
and 3 x 3 (b) supercells of graphene. To emphasize the 
inhomogeneity, we only consider the externally induced 
effects (tji, M, and Vb) on the six highlighted atomic 
sites of the supercells, while the remaining atomic sites 
are modeled as a pristine graphene. In our simulation, 
the effective tight-binding Hamiltonian is the same as 
Eq. © by setting t so = 0. 

A. 3x3 supercell of graphene 

Figure 0] plot the bulk band structure of the 3x3 
supercell of graphene in the presence of only on-site po- 
tential and the resulting gap dependence as a function 
of the on-site potential. One can observe that a trivial 
band gap A opens at V point [see Fig. BJa)]; and the 
opened band gap increases quadratically as a function of 
the on-site potential strength Vq. This confirms that it 
is the adsorption-induced on-site potential that couples 
valleys K and K' to open a band gap, consistent with the 
ab-initio calculation result in Fig. 6 of Ref. [f3[ . 

When the exchange field M is further included, the 
bulk gap first decreases due to the relative shift between 
the spin-up polarized valence band and the spin-down 
polarized conduction band [see Fig.[SJa)]. For even larger 
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FIG. 4: (a) Bulk band structure of the 3x3 supercell of 
graphene in the presence of only on-site potential Vo/t = 0.50. 
A band gap A opens at F point, (b) Bulk gap A quadratically 
increases as a function of Vo. 




r r 



FIG. 5: Bulk band structure of the 3x3 supercell of graphene 
in the presence of on-site potential Vo/t = 0.50 and exchange 
field M. (a) M/t = 0.05; (b) M/t = 0.20. t and I denote up 
and down spin polarization. 




FIG. 6: (a) Bulk band structure of the 3x3 supercell of 
graphene in the presence of on-site potential Vo/t = 0.50, 
exchange field M/2 — 0.20, and Rashba spin-orbit coupling 
tfl/t = 0.05. (b) The magnification of the band gap selected 
by dashed square. 




FIG. 7: Total Berry curvature distribution f2 in the momen- 
tum space of the occupied valence bands below the band gap. 
Only those around F point nonzero and share the same neg- 
ative sign. 



M as shown in Fig. EJb), one can observe that the gap 
is completely closed and the bands with opposite spin 
polarization cross. 

If Rashba spin-orbit coupling is considered in addition 
to the exchange field, we find that for small exchange 
field since the original band gap from on-site potential 
does not close, and the not-so-large Rashba spin-orbit 
coupling can only further reduce the band gap. However, 
for large exchange field, the situation becomes completely 
different, i.e. the Rashba spin-orbit coupling opens a new 
band gap at the band-crossing points as shown in Fig. [5] 

To explore the nontrivial topology of the newly formed 
insulating phase, we plot the total Berry curvature dis- 
tribution fl(k xi ky) of the occupied valence bands below 
the gap in Fig. [7] One can find that the nonzero Berry 
curvatures are mainly located around T point and share 



the same negative sign, suggesting a nonzero Chern num- 
ber. Through an integration of Berry curvatures over the 
first Brillouin zone, the Chern number is calculated to be 
C = 2. 

Till now, we can conclude that in the 3x3 super- 
cells of graphene, the prerequisite to realize the quantum 
anomalous Hall effect is that the exchange field should 
be large enough to close the trivial band gap arisen from 
the crystal field stabilization energy Vq. To our surprise, 
another separate work2£ proves that the randomness of 
the adsorption sites can exponentially diminish the trivial 
band gap determined by crystal field stabilization energy. 
This information manifests the high possibility of engi- 
neering the long-sought quantum anomalous Hall state 
in graphene through adsorbing random magnetic atoms. 
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FIG. 8: (a) Bulk band structure of the 4x4 supercell of 
graphene in the presence of on-site potential Vo/t = 0.50. (b) 
Magnification of bands near the Dirac crossing point. No gap 
opens at K and K' . 



FIG. 9: (a) Bulk band structure of the 4x4 supercell of 
graphene in the presence of on-site potential Vo/t = 0.50 and 
exchange field M/t — 0.20. (b) Magnification of bands near 
the Dirac crossing point. Arrows are used to denote the up 
and down spin polarizations. 



B. 4x4 supercell of graphene 

Let us now study the 4x4 supercell of graphene case. 
Figure E^a) plots the whole bulk band structure of the 
4x4 supercell of graphene in the presence of only on-site 
potential Vq, and Figure Etb) magnifies the bands at the 
low-energy region. One can observe that the bands at 
K and K' exhibit linear Dirac-type dispersion without 
opening a band gap, which are completely different from 
the result of 3 x 3 supercell of graphene. Comparing 
with the band structure of the pristine graphene, one can 
find that the bands at the low-energy regime are similar 
except a Fermi-level shifting. 

As shown in Fig. |9j when the exchange field is further 
considered, the doubly-degenerate bands become spin- 
split with spin-up bands up- ward shifting and spin-down 
bands down-ward shifting. This resembles the spin-split 
of graphene in the presence of uniformly distributed ex- 
change field^i 

Figure [TO] plots the bulk band structure of the 4x4 
supercell of graphene in the presence of on-site energies, 
exchange field, and Rashba spin-orbit coupling. One can 
observe that the Rashba spin-orbit coupling term opens 
a gap at the spin-up and spin-down band-crossing points 
near valleys K and K' . This gap formation should be 
nearly the same as that pointed out in Ref. [H| . There- 
fore, the corresponding Chern number should be C = 2. 
These tight-binding band structures reproduces the ab- 
initio band structures demonstrated in Ref. II 311 



VI. CONCLUSIONS 

In this paper, we discuss the physical origins of the 
formation of quantum anomalous Hall effect in graphene 
due to the presence of Rashba spin-orbit coupling Xr and 




FIG. 10: (a) Bulk band structure of the 4x4 supercell of 
graphene in the presence of on-site potential Vo/t = 0.50, 
exchange field M/t = 0.20, and Rashba spin-orbit coupling 
tn/2 = 0.05. (b) Magnification of bands near the Dirac cross- 
ing point. Bulk band gaps open at K and K' 

exchange field M using a continuum model. We show 
that in the limit of Mj Xr ^> 1, the quantization of the 
Hall conductance arises from Skyrmions carried by the 
real spin textures and Merons carried by AB sublattice 
pseudo-spin textures at K and K'; in the other limit 
Xr/M 3> 1, the four-band low-energy Hamiltonian is re- 
duced to an extended Haldane's model, giving rise to a 
nonzero Chern number C = 1 at either K or K' . 

We demonstrate that the quantum anomalous Hall 
phase is robust against weak staggered AB sublattice 
potential U or intrinsic spin-orbit coupling Xso- hi the 
presence of a moderate staggered AB sublattice poten- 
tial, the system undergoes a phase transition from a 
quantum anomalous Hall phase to a quantum valley- 
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Hall phase if U > M. Alternatively, when a larger 
intrinsic spin-orbit coupling is applied, graphene in a 
quantum anomalous Hall phase transitions to a time- 
reversal-symmetry broken quantum spin-Hall phased at 
Aso = (VM 5 TA|' + M)/2. 

Using a tight-binding model Hamiltonian, we repro- 
duce all the ab-initio band structures^ (at the low-energy 
level) of doping magnetic atoms on the hollow site of the 
3x3 and 4x4 supercells of graphene by considering 
the on-site energy (crystal field stabilization energy), ex- 
change field and Rashba spin-orbit coupling on only a cir- 
cle of six atomic sites, and explain the formations of the 
quantum anomalous Hall state in the 3x3 and 4x4 su- 
percells of graphene. For the 3x3 supercell of graphene, 
we show that the crystal field stabilization energy is cru- 
cial to couple valleys K and K' to open a trivial bulk 
band gap at V point in the absence of exchange field and 
Rashba spin-orbit coupling. We also find that only when 
the exchange field is large enough to close the trivial band 
gap from the crystal field stabilization energy, a nontriv- 
ial bulk band gap exhibiting the quantum anomalous Hall 
effect can be opened due to the presence of Rashba spin- 



orbit coupling. For the 4x4 supercell of graphene, due to 
the separation of valleys, no band gap opens when only 
the crystal field stabilization energy is present. When 
exchange field and Rashba spin-orbit coupling are con- 
sidered simultaneously, the physical mechanism to open 
a bulk gap is exactly the same as that in the presence of 
uniformly distributed parameters^ 
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